Voice communication device with foreign language translation

ABSTRACT

Methods and devices for voice communications and foreign language translation are disclosed. One method includes selecting one of a plurality of microphones of an earpiece unit, receiving a selected voice communication of a first language from the selected microphone and translating the selected voice communication from the first language to a second language, the second language different from the first to create a translated voice communication, and transducing the translated voice communication at a speaker within the earpiece unit. Preferably the microphones are oriented in different directions and are directional microphones. The present invention further optionally provides for the sensing and transmission of pulse oximeter measurements and temperature measurements.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a Continuation application of U.S. Ser. No. 13/967,413, filedAug. 15, 2013, which claims priority to U.S. Ser. No. 10/022,022, filedDec. 13, 2001, which is now U.S. Pat. No. 8,527,280, issued on Sep. 3,2013, all of which are herein incorporated by reference in theirentirety.

BACKGROUND OF THE INVENTION

The present invention relates to a voice communication device withforeign language translation. Given the widespread availability oftravel the need for foreign language translation has increased. Thepresent invention has applications in numerous areas and instances whereforeign language translation is desirable. One particular application ofthe present invention is in military applications.

U.S. troops have often been required to render assistance in numerousforeign environments. For example, U.S. troops have been used as membersof peacekeeping forces in various countries. Further, U.S. troops havebeen deployed to counter terrorism in the Middle East. In these andother situations, these military personnel are placed at a disadvantageand are potentially subjected to dangers, heightened by the fact thatthese personnel are unable to speak the native languages used by thepeople around them. In these types of missions, there is an acute needto be able to understand the locals or natives. The military personnelhave a huge and heavy burden of administering justice by neutralizingthreats without compromising the safety of innocents in an effort toreduce or eliminate any collateral damage. This places militarypersonnel in a difficult situation.

The identification of potential threats would be aided if the militarypersonnel could understand the language used by the people around them.Knowledge of a foreign language has long been considered an asset in themilitary. For example, Green Berets are required to speak at least asecond language. Nevertheless, given the tenure of today's society whereit is not known where conflict may arise and it is not known whatlanguage military personnel should be versed in, it is not practical tohave sufficient numbers of troops who speak every language that isneeded. This problem is further complicated by the fact that there arenumerous dialects associated with various languages. Further, even ifsome troops are skilled in a particular language, it is impractical forevery troop to be skilled in that language. Therefore, problems remain.

These same problems are also prevalent in contexts outside of themilitary. For example, people involved in business, education, and eventourists have reason to speak languages beyond their native tongue.Learning a foreign language can be time-consuming, and many people maynot have the time or discipline to do so. Further, many people have theneed to communicate in a variety of foreign languages, and it is oftenimpractical for these people to learn every foreign language they mightencounter.

Therefore, as a primary object of the present invention to improve uponthe state of the art.

It is a further object of the present invention to provide a voicecommunication device which provides for foreign language translation.

Yet another object of the present invention is to provide a voicecommunication device which is nonocclusive in nature.

Yet another object of the present invention is to provide a voicecommunication device that is small and lightweight.

Another object of the present invention is to provide a voicecommunication device that a soldier can wear in conjunction with ahelmet.

Yet another object of the present invention is to provide a voicecommunication device that is capable of listening in on voicecommunications that may be outside the range of normal human hearing.

A further object of the present invention is to provide a voicecommunication device that is capable of listening to voice conversationsin multiple directions relative to the operator of the voicecommunications device.

These and other objects, features, and advantages of the presentinvention will become apparent from that which is now described.

BRIEF SUMMARY OF THE INVENTION

The present invention includes methods and devices for foreign languagetranslation. According to one embodiment of the present invention, anonocclusive earpiece that allows the wearer to continue to hearenvironmental sounds is disclosed. The nonocclusive earpiece includes aplurality of microphones, preferably directional. The directionalmicrophones allow reception of voice communications in microphonepositions or orientations relative to the person wearing the earpiece.One of the pluralities of directional microphone may be selected eithermanually or automatically. Voice sound information received by thecorresponding directional microphone can then be amplified andprocessed. The resulting voice sound information signal is thentranslated. The translation may occur locally within the earpiece.Alternatively, the translation may occur at a remote location. Whentranslation occurs remotely, the earpiece transmits the selected signalto a translation unit which translates the voice communication andtransmits the resulting translation back to the earpiece. The earpiecereceives the translation and transduces the translated voice soundinformation through a speaker disposed within the earpiece.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a pictorial representation of the nonocclusive earpiece of thepresent invention.

FIG. 2 is a block diagram of the electrical system of one earpieceaccording to the present invention.

FIG. 3 is a block diagram of one embodiment of the translation stationaccording to the present invention.

FIG. 4 is a block diagram of another translation system according to thepresent invention.

FIG. 5 is a block diagram of an electrical system of another embodimentof the earpiece of the present invention providing physiologicalmonitoring.

FIG. 6 is another block diagram of an electrical system of oneembodiment of the earpiece of the present invention.

FIG. 7 is another block diagram of one embodiment of the earpiece unitof the present invention.

DETAILED DESCRIPTION OF THE INVENTION

The present invention will now be described as it applies to anexemplary embodiment. It is not intended that the present invention belimited to the described embodiment. It is intended the invention coverall modifications and alternatives which may be included within thespirit and scope of the invention.

FIG. 1 shows a front view of one embodiment of an earpiece according tothe present invention. The earpiece 10 preferably does not occlude theexternal auditory canal. The earpiece 10 includes a speaker 12. Inaddition, the earpiece 10 includes a plurality of microphones. Forexample, microphones shown include a front microphone 18 directed in afrontward direction, a side microphone 20, directed in an outwarddirection, and a rear microphone 22, directed in a rearward direction.Each of these microphones is preferably a directional microphone,although omnidirectional microphones may be used. In addition, theearpiece 10 includes an optional pulse oximeter 14 and an optionalthermistor 16 or other temperature sensor. The pulse oximeter 14 isplaced such that oxygen saturation, and other measurements associatedwith pulse oximeters are performed. The thermistor 16 provides a bodytemperature reading. These sensors provide physiological monitoring ofthe operator. In military applications, such sensors are of greatimportance, particularly in an era where biological and/or chemicalwarfare remains a threat. In addition to these optional features, theearpiece unit shown includes an optional expansion slot 24. Theexpansion slot 24 can be of a variety of structures. The expansion slot24 allows additions in functionality to be added to the earpiece 10without replacing the entire earpiece. The expansion slot 24 can receivecards, modules, or other expansion units that provided added features,functionalities, and/or memory such as may be appropriate for aparticular use or application.

The earpiece 10 shown in FIG. 1 can be worn under a helmet by militarypersonnel if need be. The relative small size and light weight of thedevice allow the device to be worn comfortably. Although abehind-the-ear (BTE) earpiece is shown, the present invention furtherallows for a completely-in-canal (CIC) device also to be worn.Preferably the earpiece does not occlude the external auditory canal ofa user. One example of an earpiece that does not occlude the externalauditory canal of a user is disclosed in U.S. Pat. No. 6,094,492, hereinincorporated by reference in its entirety.

FIG. 2 provides a block diagram of one embodiment of the earpiece of thepresent invention. As shown in FIG. 2, the earpiece 10 is shown. Theearpiece 10 includes a first microphone 18, a second microphone 20, anda third microphone 22. Each of the plurality of microphones isoperatively connected to a microphone control unit 24. The microphonecontrol unit 24 is used to manually or automatically select one of theplurality of microphones for transmission over the short-rangetransceiver 26. The earpiece unit 10 also includes a short rangereceiver 28 operatively connected to a speaker 12. According to thisembodiment of the present invention, one of a plurality of themicrophones is selected. The microphone may be selected manually orautomatically. The sound information signal associated with thatmicrophone, preferably a voice sound communication, is then transmittedover the short-range transceiver 26. A translated voice soundcommunication is then received by the short range receiver 28 and thentransduced on the speaker 12 such that the wearer of the earpiece 10hears the translated voice sound information.

FIG. 3 shows a translation unit 30 according to the present invention.As shown in FIG. 3, a short-range receiver 32 is operatively connectedto a translator 36. The translator 36 is operatively connected to ashort-range transceiver 34. The translator unit 30 receivestransmissions of voice sound information of a first language from theearpiece unit 10 at the short range receiver 32, then translates thevoice sound information from the first language to a second language andsends the resulting translated voice sound information back to theearpiece unit 10 through the short range transceiver 34. The presentinvention contemplates numerous variations in the implementation of thetranslator. In particular, the translator 36 can be a computer adaptedfor voice translation. Various translator products are available ascommercial off-the-shelf products or are available online. Examplesinclude the Franklin language translators, Lernout & Hauspie's PowerTranslator Pro, and others. The present invention contemplates that thereceived voice sound information may be processed using voicerecognition or other voice to text applications in a first language, andthen the resulting text information is then translated to text of asecond language. The text of the second language is then converted fromtext to voice. Preferably such a system is real time or near real time.The present invention is in no way limited to a particular translationmethod, or language, and allows for any number of such translationmethods and languages to be used. The computer used can be a PersonalDigital Assistant (PDA), embedded computer, or other computer orelectronic device.

FIG. 4 provides a block diagram of another embodiment of the presentinvention. FIG. 4 provides for a translation system 40 in operativecommunication with the earpiece unit. In FIG. 4, a short-range receiver42 receives a voice communication from the earpiece unit. Thisinformation is then sent over a communications channel 46 to atranslator 50. In this implementation of the present invention, thetranslator 50 may be at a remote location that is further than a shortrange from the earpiece unit. The information received from the earpieceis effectively relayed across the communications channel 46. Similarly,information from the translator 50 is effectively relayed across thecommunications channel 46 back to the short-range transmitter 44 whichis in operative communication with the earpiece unit 10. In thisembodiment, the computer performing the translation need not be on siteand can be well-removed from the earpiece 10 and operator.

FIG. 5 provides a block diagram of another embodiment of the earpieceunit according to the present invention, this embodiment using an inputswitch 64. In FIG. 5, earpiece unit 60 is shown. The earpiece unitincludes a first microphone 18, second microphone 20, and a thirdmicrophone 22 electrically connected to an input switch 64. The inputswitch 64 is one type of microphone control unit that can be used. Theinput switch 64 routes the output of one of the microphones to thetransmitter 26. The input switch 64 allows one of the plurality ofmicrophones to be selected. The input switch 64 is operativelycontrolled by the controller 62. The controller is an intelligentcontrol. The present invention contemplates any number of types ofintelligent controls that can be used according to the presentinvention. This includes processors, microcontrollers, digital signalprocessors, integrated circuits, portions of an integrated circuit,control circuits, and other types of intelligent controls.Alternatively, the input switch 64 is manually controlled. The selectedinput is then relayed to the transmitter 26 which transmits the voicesound communication. The receiver 28 receives the translated voicecommunication and is capable of outputting the translated voicecommunication to a speaker 12. In addition, the controller 62 iselectrically connected to a pulse oximeter 66 within the earpiece. Thepulse oximeter 66 is used to determine oxygen concentration within theblood of the wearer of the earpiece. In addition, a thermistor 68 iselectrically connected to the controller 62 such as through an analog todigital converter 70. The analog to digital converter 70 may be builtinto the controller 62. The present invention provides for informationobtained from the pulse oximeter 66 as well as the thermistor 68 to betransmitted with the transmitter 26.

The transmitter 26 provides for the transmission of one or more audiostreams such as voice communications from one of the plurality ofmicrophones. In addition, the transmitter preferably allows for thetransmission of digital information received from the controller 62.This digital information can include pulse oximeter measurements as wellas temperature measurements. In such a transmitter, the transmitter canprovide for modulation of the digital data such that both analog anddigital information can be received. The present invention alsocontemplates that the controller 62 can provide the same function ifneed be by modulating the digital information through pulse widthmodulation into audio.

FIG. 6 provides a block diagram of another embodiment of the presentinvention. FIG. 6 illustrates earpiece 72. According to FIG. 6, thepresent invention provides for the audio received from the selectedmicrophone to be output directly to the speaker 12 as well as to thetransmitter 26. The output switch 74 allows this selection to be made.Such a feature is useful when the audio received from the selectedmicrophone is amplified or is otherwise louder or clearer than thatwhich the user would hear without the earpiece. Thus, even if theoperator understands the languages being spoken, the present inventionstill provides advantages.

FIG. 7 is a block diagram of another embodiment of an earpiece 80 of thepresent invention. In FIG. 7, the earpiece unit includes a boneconduction sensor 82 in addition to a plurality of microphones. Each ofthe plurality of microphones as well as the bone conduction sensor 82 iselectrically connected to an audio mixer 84. The audio mixer 84 allowsthe signals from each of the microphones as well as the bone conductionsensor 82 to be mixed in various proportions as controlled by thecontroller 62 which is electrically connected to the audio mixer 84. Inaddition, the earpiece 80 includes an audio switch 86 electricallyconnected to each of the microphones and the bone conduction sensor 82.This allows the speaker 12 to transduce any one of the selected signals.Further, a controller 62 is electrically connected to a modulator 88 forcombining data into the audio signal which is mixed by audio mixer 84and transmitted by the transmitter 26. This allows voice communicationsfrom the operator, as transduced by the bone conduction sensor 82 or oneof the microphones to be communicated. When the bone conduction sensor82 is used, the operator can speak covertly so that those around theoperator can not hear the operator speaking.

Further, the earpiece is preferably nonocclusive in nature. This allowsthe operator to continue to hear the operator's surroundings even thoughthe operator is also using the earpiece to receive voice communications.

Therefore, a voice communication device with foreign languagetranslation has been disclosed. The present invention contemplatesnumerous variations in the languages translated, the specifictranslation product or device used, the number of microphones used,whether a bone conduction sensor, pulse oximeter, and/or temperaturesensor are used, whether the translation occurs within the ear piece,within a device that is located within a short range of the ear piece,or by a device located remotely, whether the antenna used be directionalor omnidirectional and other variations. The scope of the presentinvention should be construed broadly and is only to be limited to thatwhich is claimed and all equivalents.

What is claimed is: 1: A method for voice translation comprising:providing to a first person a translation device having a housing and amicrophone and a speaker within the housing; receiving at the microphoneof the translation device a voice communication in a first language froma second person while the translation device is physically with thefirst person; processing the voice communication in the first languageinto text in the first language using the translation device;translating the text in the first language to text in a second language;converting the text in the second language to a voice communication inthe second language; and transducing the voice communication in thesecond language at the speaker of the translation device to the firstperson. 2: The method of claim 1 wherein the translation devicecomprises an earpiece. 3: The method of claim 2 wherein the processingthe voice communication is performed by a processor of the earpiece. 4:The method of claim 2 wherein the earpiece comprises a plurality ofmicrophones. 5: The method of claim 1 wherein the translating isperformed at a remote location. 6: A method for voice translationcomprising: providing to a first person a translation device having ahousing and a microphone and a speaker within the housing; receiving ata microphone of a translation device a voice communication in a firstlanguage from a second person while the translation device is physicallywith the first person; processing the voice communication in the firstlanguage into text in the first language using a processor disposedwithin the translation device; translating the text in the firstlanguage to text in a second language using the processor disposedwithin the translation device; converting the text in the secondlanguage to a voice communication in the second language; andtransducing the voice communication in the second language at a speakerof the translation device. 7: The method of claim 6 wherein thetranslation device is an earpiece. 8: The method of claim 6 wherein theearpiece comprises a plurality of microphones. 9: A method of voicetranslation comprising: providing a device having a housing and amicrophone and a speaker within the housing; receiving from a secondperson a voice communication of a first language from the microphone ofthe device while the device is physically with the first person;electronically translating the voice communication from the firstlanguage to a second language by the device, the second languagedifferent from the first to create a translated voice communication;transducing the translated voice communication at the speaker of thedevice to the first person. 10: The method of claim 9 further comprisingdirecting the microphone of the device towards a speaker of the firstlanguage. 11: The method of claim 10 wherein the step of providingcomprises providing to a user, the speaker of the first language being aperson other than the user. 12: The method of claim 1 further comprisingdirecting the microphone of the device towards a speaker of the firstlanguage. 13: The method of claim 12 wherein the step of providingcomprises providing to a user, the speaker of the first language being aperson other than the user. 14: The method of claim 2 wherein theearpiece comprises a behind-the-ear earpiece. 15: The method of claim 2wherein the earpiece comprises an in-canal earpiece. 16: The method ofclaim 2 wherein the earpiece comprises a nonocclusive earpiece. 17: Themethod of claim 2 wherein the earpiece further comprises a boneconductor sensor. 18: The method of claim 4 wherein the microphones aredirectional microphones. 19: The method of claim 18 further comprising amicrophone control to switch between the microphones. 20: The method ofclaim 1 wherein the translating comprises: processing the voicecommunication in the first language into text in the first languageusing the translation device; translating the text in the first languageto text in a second language; converting the text in the second languageto a voice communication in the second language; and transducing thevoice communication in the second language at the speaker of thetranslation device to the first person.